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TITLE OF THE INVENTION 

MOTION ESTIMATION APPARATUS, METHOD, AND MACHINE-READABLE MEDIUM 
CAPABLE OF DETECTING SCROLLING TEXT AND GRAPHIC DATA 

CROSS-REFERENCE TO RELATED APPLICATIONS 

[0001] This application claims the benefit of Korean Application No. 10-2002-73330, which 
was filed on November 23, 2002, in the Korean Intellectual Property Office, the disclosure of 
which is incorporated herein by reference. 



BACKGROUND OF THE INVENTION 

1. Field of the Invention 

[0002] The present invention relates to a motion estimation apparatus and a method thereof, 
and, more particularly, to a motion estimation apparatus and a method thereof capable of 
detecting scrolling text and graphic data in a horizontal direction on a screen. 

2. Description of the Related Art 

[0003] There exist the interlaced scan mode and the progressive scan mode for scan modes 
for a video display device. The interlaced scan mode is used for general TVs and so on, and 
refers to a mode that, when one image is displayed, divides one frame image into two fields and 
sequentially displays the two fields one after the other, whereas the progressive scan mode is 
used for computer monitors, digital TVs, and so on, and refers to a mode that displays at a time 
entire frames with one image frame processed as a unit frame just like a film is projected on a 
screen. 

[0004] As more video display devices of progressive scan mode are used and, at the same 
time, the necessity of data exchanges among devices using different scan modes grows, the 
importance is placed more than ever before on the interlaced-to-progressive conversion (IPC) 
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method that converts the interlaced scan mode into the progressive scan mode. Therefore, IPC 
methods having a far more enhanced performance are required to obtain images of better 
quality. 

[0005] There exist diverse methods for interlaced-to-progressive conversions. As basic 
methods, there are an intra-field IPC method that inserts average data of two-line data between 
two lines of a current field to implement a new field, and an inter-field IPC method having no 
motion compensation that inserts between lines of a current field average data of data ahead of 
and behind the current field to implement one frame. Such IPC methods are easily 
implemented, but cannot achieve a satisfactory image quality. Accordingly, a motion- 
compensated IPC method has been proposed that divides an image into plural blocks with 
respect to time-continuous field data with reference to current field data, obtains motions for the 
respective blocks, and interpolates a current frame image with reference to vectors of the 
motions. A motion-adaptive IPC method has been also proposed that estimates the extent of 
motions and interpolates frames based on the motions, and so on. Such IPC methods can 
obtain an image quality better than the basic methods, but have relatively more complicated 
hardware. 

[0006] However, the IPC methods are not suitable for displays of text or graphic data such as 
news, programs, stock prices, whether, and so on, with horizontal scrolling at the bottom of a 
screen, and so on. That is, due to the characteristics of scrolling text or graphic data, in case 
that the intra-field IPC method or the intra-field IPC method is used, text in interpolated images 
is not clearly displayed, and displays broken letters on many occasions. Further, in case of 
scrolling text or graphic data, because plural lines move on the screen in the horizontal direction 
at a certain speed, image interpolations can be easily implemented if there is information of 
whether scrolling text or graphic data exists and a scrolling speed, so that excellent image 
interpolations in terms of performance or speed become possible without the use of a 
complicated algorithm such as the motion-compensated IPC method or the motion-adaptive IPC 
method. 

[0007] Therefore, a motion estimation apparatus and a method applicable to IPC methods 
and the like become necessary for detecting whether text or graphic data scrolling in the 
horizontal direction of a screen exists and proving information necessary for image 
interpolations. 
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SUMMARY OF THE INVENTION 

[0008] Accordingly, it is an aspect of the present invention to provide a motion estimation 
apparatus and a method capable of detecting whether text or graphic data scrolling in the 
horizontal direction of a screen exists, and providing information necessary for image 
interpolations. 

[0009] Additional aspects and advantages of the invention will be set forth in part in the 
description which follows and, in part, will be obvious from the description, or may be learned by 
practice of the invention. 

[0010] In order to achieve the above aspect, a motion estimation apparatus according to the 
present invention comprises a line-wise motion estimation unit for calculating motion vectors 
indicating the extent of motions in a horizontal direction for individual lines of a predetermined 
search area with reference to a current field/frame and a reference field/frame; a motion vector 
buffer for storing motion vectors for the individual lines; a scroll detection unit for determining 
whether scroll motions exist in the current field/frame based on the motion vectors for the 
individual lines which are stored in the motion vector buffer; and a scroll line detection unit for 
determining whether the scroll motions exist in the individual lines of the search area, based on 
a result of the determination of the scroll detection unit. 

[001 1] The line-wise motion estimation unit includes a pixel buffer for sequentially storing 
pixel data constructing lines to calculate the motion vectors in the reference field/frame; a FIFO 
buffer for sequentially storing pixel data constructing lines to calculate the motion vectors in the 
current field/frame; an SAD buffer for calculating and storing summed absolute difference (SAD) 
values based on estimations of the extent of motions, using the pixel data respectively stored in 
the pixel buffer and the FIFO buffer; and a motion vector estimator for calculating the motion 
vectors based on the SAD values stored in the SAD buffer. In here, it is possible that the motion 
vector estimator calculates the motion vectors in correspondence to a motion estimation 
position having the minimum value of the SAD values stored in the SAD buffer. 

[0012] The motion estimation apparatus further comprises a motion detector for determining 
the validity of the motion vectors calculated by the motion vector estimator; and an output 
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selector for selectively outputting only selected motion vectors based on a result of the validity 
decision of the motion detector. At this time, the motion estimator determines that the motion 
vectors are valid if a difference between the maximum value and the minimum value of the SAD 
values stored in the SAD buffer is larger than a predetermined threshold value. 

[0013] The scroll detection unit calculates the number of occurrences by magnitudes of the 
motion vectors stored in the motion vector buffer, and determines that the scroll motions exist 
when motion vectors of certain magnitudes are determined to be more than the predetermined 
number of occurrences. Further, the scroll line detection unit may decide that the scroll motions 
exist in corresponding lines when motion vectors calculated line by line correspond to the 
magnitudes of motion vectors are determined to be more than the predetermined number of 
occurrences. 

[0014] In the meantime, a motion estimation method according to the present invention 
comprises (a) calculating motion vectors indicating the extent of motions in a horizontal direction 
for individual lines of a predetermined search area with reference to a current field/frame and a 
reference field/frame; (b) storing motion vectors for the individual lines; (c) determining whether 
scroll motions exist in the current field/frame based on the stored motion vectors for the 
individual lines; and (d) determining whether the scroll motions exist in the individual lines of the 
search area, based on a result of the decision of the step(c). 

[0015] Operation (a) further comprises (a1) sequentially storing pixel data constructing lines 
to calculate the motion vectors in the reference field/frame; (a2) sequentially storing pixel data to 
calculate the motion vectors in the current field/frame; (a3) calculating and storing summed 
absolute difference(SAD) values based on estimations of the extent of motions, using the pixel 
data respectively stored in operations(al) and (a2); and (a4) calculating the motion vectors 
based on the stored SAD values. In here, it is possible that operation(a4) calculates the motion 
vectors in correspondence to a motion estimation position having the minimum value of the 
stored SAD values. 

[0016] The motion estimation method further comprises determining the validity of the 
motion vectors calculated in operation(a4); and selectively outputting only valid motion vectors 
based on a result of the validity determination. At this time, the determining the validity 
determines the motion vectors as valid if a difference between the maximum value and the 
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minimum value of the SAD values stored in the SAD buffer is larger than a predetermined 
threshold value. 

[0017] Operation (c) calculates the number of occurrences by magnitudes of the stored 
motion vectors, and determines that the scroll motions exist when motion vectors of certain 
magnitudes are determined to be more than the predetermined number of occurrences. 
Further, operation(d) may determines that the scroll motions exist in corresponding lines are 
determined to be motion vectors calculated line by line corresponds to the magnitudes of motion 
vectors detected more than the predetermined number of occurrences. 



BRIEF DESCRIPTION OF THE DRAWINGS 

[0018] These and other aspects and/or advantages of the present invention will become 
apparent and more readily appreciated from the following description of the preferred 
embodiments, taken in conjunction with the accompanying drawings of which: 

FIG. 1 is a block diagram for showing a motion estimation apparatus, according to an 
embodiment of the present invention; 

Fig.2 is a block diagram for showing a line-wise motion estimation unit of FIG. 1; and 

FIG. 3 is a flow chart for explaining an operation process for a motion estimation 
apparatus, according to an embodiment of the present invention. 



DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 

[0019] Reference will now be made in detail to the embodiments of the present invention, 
examples of which are illustrated in the accompanying drawings, wherein like reference 
numerals refer to the like elements throughout. 

[0020] FIG. 1 is a block diagram for showing a motion estimation apparatus according to an 
embodiment of the present invention. The motion estimation apparatus includes a line-wise 
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motion estimation unit 100, a demultiplexer 150, a motion vector buffer 200, a scroll detection 
unit 250, a scroll line detection unit 300, and a multiplexer 350. 

[0021] The line-wise motion estimation unit 100 calculates motion vectors indicating motions 
in a horizontal direction with reference to lines of inputted reference field/frame and current 
field/frame. In here, the reference field/frame denotes a reference field or a reference frame, 
and the current field/frame denotes a current field or a current frame. 

[0022] The motion vector buffer 200 stores motion vectors estimated in the line-wise motion 
estimation unit 100 with respect to individual lines. At this time, the demultiplexer 150 stores 
corresponding motion vectors at positions allocated in the motion vector buffer 200 to the 
respective lines based on inputted line number information. 

[0023] The scroll detection unit 250 determines whether there exist scroll motions of text, 
graphic data, or the like in a horizontal direction in a current field/frame based on the motion 
vectors stored in the motion vector buffer 200. Further, the scroll line detection unit 300 
determines whether there exist scroll motions with respect to individual lines in case that the 
scroll motions exist in the current field/frame. 

[0024] FIG. 2 is a block diagram for showing in detail the line-wise motion estimation unit 100 
of FIG. 1. 

[0025] In FIG. 2, the motion estimation unit 100 is constructed with a pixel buffer 101, an 
SAD buffer 103, an FIFO buffer 105, an motion detector 107, a motion vector estimator 109, and 
an output selector 111. 

[0026] The pixel buffer 101 sequentially inputs and stores pixels forming lines for which 
motion vectors are calculated in a reference field/frame. The FIFO buffer 105 sequentially 
inputs and stores pixels forming lines for which motion vectors are calculated in a current 
field/frame. The SAD buffer 103 stores summed absolute difference (SAD) values calculated by 
using pixel data stored in the pixel buffer 101 and the FIFO buffer 105. The motion vector 
estimator 109 calculates motion vectors from the SAD values stored in the SAD buffer 103. The 
motion detector 107 determines the validity of estimated motion vectors. Further, the output 
selector 111 outputs motion vectors determined to be valid based on the validity decision. If 
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decided as invalid motion vectors, a certain constant const can be outputted to notify of 
invalidity. 

[0027] FIG. 3 is a flow chart for explaining an operation process for a motion estimation 
apparatus according to an embodiment of the present invention. 

[0028] In the operation process of FIG. 3, first, the line-wise motion estimation unit 100 
calculates an SAD value with respect to the i th line in a specified search area based on a 
reference field/frame and a current field/frame (S300). In general, since scrolling text or graphic 
data exists at the bottom of a screen, it is possible to enhance a processing speed by properly 
setting a search area instead of calculating SAD values over the entire field/frame. 

[0029] SAD values in a search area are calculated through a process as below. First, the 
pixel buffer 121 stores pixel data constructing the i th line of a reference field/frame, and the FIFO 
buffer 125 stores pixel data constructing the i th line of a current field/frame. The pixel data for 
the reference field/frame and the current field/frame are sequentially inputted and stored till an 
SAD value for the i th line is completely calculated. The calculated SAD value is stored at a 
corresponding position in the SAD buffer 103. The SAD value is calculated from following 
Formula 1 . 

Formula 1 

Ofc v) = X I f ref (i, y - v) - f cur (/, 7 + 

7=0 

[0030] In here, f ref {ij - v) denotes pixel data positioned at a j-v column of the i th line in a 

reference field/frame, and f cur {ij + v) pixel data positioned at a j+v column of the i th line in a 
current field/frame. As shown in Formula 1, an SAD value is calculated with v value changes, 
and the v corresponds to a motion estimation position. 

[0031] If the calculation of the SAD value for the i th line is completed through the above 
process, the motion vector estimator 109 estimates as the motion vector a position having the 
minimum value out of the SAD values stored in the SAD buffer 103 (S302). This is expressed in 
Formula 2 as below. 

Formula 2 
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V = argmin<D(/,v) 

[0032] The motion detector 107 determines the validity of a motion vector v estimated from 
the minimum and maximum values out of the SAD values stored in the SAD buffer 103 (S304). 
The motion vector is determined to be valid if a difference between the minimum and maximum 
values of the SAD values is larger than a predetermined first threshold value Th1 as shown in 
Formula 3 as below. Otherwise the motion vector is determined to be invalid. 

Formula 3 

, F ( maxO0,v)-min(D0» j> Th1j the estimated motion vector is valid; 
ELSE the estimated motion vector is invalid. 

[0033] The output selector 11 1 outputs a motion vector decided to be valid in the motion 
detector 107, and stores the motion vector at a corresponding position of the motion vector 
buffer 200 (S306). In this case, if the estimated motion vector is not valid, it may be possible 
that the output selector 11 1 outputs a certain constant const to be stored. This may be 
expressed in Formula 4 as below. 

Formula 4 

vscr[i] = V 

in the above Formula 4, i denotes a line number, and vscr[i] a buffer allocated in the motion 
vector buffer 200 with respect to respective lines. 

[0034] After a motion vector for the i th line is stored, it is decided whether the i th line is the last 
line of an area set as a search area (S308), and, if the i th line is not the last line, the above 
process is repeated up to the last line of the search line. 

[0035] The scroll detection unit 250 estimates whether there exists on a current field/frame 
view a scroll motion of text, graphic data, or the like from the motion vectors stored in the motion 
vector buffer 200 (S310). The estimation of whether there exists the scroll motion of text, 
graphic data, or the like follows a process as below. 

[0036] First, the scroll detection unit 250 calculates the number of occurrences by magnitude 
with respect to motion vectors V stored in the motion vector buffer 200, and, if a predetermined 
number of occurrences of motion vectors of certain magnitude appears, decides that the scroll 
motion exists. That is, In case that scrolling text or graphic data exists, some lines move in the 
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horizontal direction at the same speed, so that a certain number of motion vectors of the same 
magnitude exist. 

[0037] Through the above process, it is decided that there exist a scroll motion on a current 
field/frame, the scroll detection unit 250 outputs a "1" as a scroll flag signal flag_scr (S312 and 
S314), and, otherwise, outputs a "0" for the scroll flag signal flag_scr (S312 and S314). This is 
expressed in Formula 5 as below. 

Formula 5 

IF max hist[V] > Th2, flag_scr = 1 
ELSE flag_scr = 0 

[0038] In here, hist[V] denotes a histogram for motion vectors, and Th2 a predetermined 
second threshold value. The scroll flag signal flag_scr outputted from the scroll detection unit 
250 may be used as a signal for external devices that indicates whether the scroll motion exists. 

[0039] The scroll line detection unit 300 estimates whether scrolling text or graphic data 
exists line by line in a search area in case that the scrolling text or graphic data exists (S316). 

[0040] The decision on the scroll motion for each line is made by whether the motion vector 
estimated line by line corresponds to a motion vector over the certain number of occurrences 
used when the scroll detection unit 250 determines whether the scroll motion exists. If it is 
decided that scrolling text or graphic data is included in a corresponding line through such a 
determination process, the scroll line detection unit 300 outputs "1" for a corresponding scroll 
line flag flag_scr_line[i], and, otherwise, outputs a "0" for the corresponding scroll line flag 
flag_scrjine[i]. Such a process is carried out for all the lines in a search area, so it is 
determined whether scroll motions exist line by line. 

[0041] The motion vectors, scroll flag flag_scr, and scroll line flag flag_scr_line[i] calculated 
by the above process may be used for IPC methods. For example, as to an area in which scroll 
motions exists, information such as the motion vectors, scroll flag flag_scr, and scroll line flag 
flag_scr_line[i] calculated by the above process is used for image interpolations, and, for other 
areas, an IPC method of appropriate mode is used for image interpolations. Through such a 
process, better quality images and an improved processing speed can be obtained, compared 
to a case that image interpolations are carried out without consideration of scrolling text or 
graphic data. 
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[0042] As described above, the present invention can detect by a relatively simple method 
whether text or graphic data scrolling in a horizontal direction on a screen exists. Further, the 
present invention also provides information, such as motion vectors and the like, which is 
related to scrolling text or graphic data and can be used for image interpolations, enabling 
image interpolations advantageous in aspects of improvements of image quality and processing 
speed. 

[0043] The hardware included in the system may include memories, processors, and/or 
Application Specific Integrated Circuits ("ASICs"). Such memory may include a machine- 
readable medium on which is stored a set of instructions (i.e., software) embodying any one, or 
all, of the methodologies described herein. Software can reside, completely or at least partially, 
within this memory and/or within the processor and/or ASICs. For the purposes of this 
specification, the term "machine-readable medium" shall be taken to include any mechanism 
that provides (i.e., stores and/or transmits) information in a form readable by a machine (e.g., a 
computer). For example, a machine-readable medium includes read only memory ("ROM"), 
random access memory ("RAM"), magnetic disk storage media, optical storage media, flash 
memory devices, electrical, optical, acoustical, or other form of propagated signals (e.g., carrier 
waves, infrared signals, digital signals, etc.), etc. 

[0044] Although a few embodiments of the present invention have been shown and 
described, it will be understood by those skilled in the art that various changes in form and 
details may be made therein without departing from the spirit and scope of the present invention 
as defined by the appended claims and their equivalents. 
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